Journal of Educational Evaluation for Health Professions

Research articles

Development and validation of a portfolio assessment system for medical schools in Korea: Dong Mi Yoo, A Ra Cho, Sun Kim; J Educ Eval Health Prof. 2020;17:39. Published online December 9, 2020; DOI: https://doi.org/10.3352/jeehp.2020.17.39

4,732 View
207 Download
2 Web of Science
3 Crossref

Purpose
Consistent evaluation procedures based on objective and rational standards are essential for the sustainability of portfolio-based education, which has been widely introduced in medical education. We aimed to develop and implement a portfolio assessment system, and to assess its validity and reliability.
Methods
We developed a portfolio assessment system from March 2019 to August 2019 and confirmed its content validity through expert assessment by an expert group comprising 2 medical education specialists, 2 professors involved in education at medical school, and a professor of basic medical science. Six trained assessors conducted 2 rounds of evaluation of 7 randomly selected portfolios for the “Self-Development and Portfolio II” course from January 2020 to July 2020. These data are used inter-rater reliability was evaluated using intra-class correlation coefficients (ICCs) in September 2020.
Results
The portfolio assessment system is based on the following process; assessor selection, training, analytical/comprehensive evaluation, and consensus. Appropriately trained assessors evaluated portfolios based on specific assessment criteria and a rubric for assigning points. In the analysis of inter-rater reliability, the first round of evaluation grades was submitted, and all assessment areas except “goal-setting” showed a high ICC of 0.81 or higher. After the first round of assessment, we attempted to standardize objective assessment procedures. As a result, all components of the assessments showed close correlations, with ICCs of 0.81 or higher.
Conclusion
We confirmed that when assessors with an appropriate training conduct portfolio assessment based on specified standards through a systematic procedure, the results are reliable.

Citations

Citations to this article as recorded by

Development of an electronic learning progression dashboard to monitor student clinical experiences
Hollis Lai, Nazila Ameli, Steven Patterson, Anthea Senior, Doris Lunardon
Journal of Dental Education.2022; 86(6): 759. CrossRef
Medical Student Portfolios: A Systematic Scoping Review
Rei Tan, Jacquelin Jia Qi Ting, Daniel Zhihao Hong, Annabelle Jia Sing Lim, Yun Ting Ong, Anushka Pisupati, Eleanor Jia Xin Chong, Min Chiam, Alexia Sze Inn Lee, Laura Hui Shuen Tan, Annelissa Mien Chew Chin, Limin Wijaya, Warren Fong, Lalit Kumar Radha K
Journal of Medical Education and Curricular Development.2022; 9: 238212052210760. CrossRef
Development of Teaching and Learning Manual for Competency-Based Practice for Meridian & Acupuncture Points Class
Eunbyul Cho, Jiseong Hong, Yeonkyeong Nam, Haegue Shin, Jae-Hyo Kim
Korean Journal of Acupuncture.2022; 39(4): 184. CrossRef

Evaluation of a portfolio-based course on self-development for pre-medical students in Korea: Dong Mi Yoo, A Ra Cho, Sun Kim; J Educ Eval Health Prof. 2019;16:38. Published online December 11, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.38

6,146 View
134 Download
2 Web of Science
2 Crossref

Abstract PDF Supplementary Material

Purpose
We have developed and operated a portfolio-based course aimed at strengthening pre-medical students’ capabilities for self-management and self-improvement. In order to determine the effectiveness of the course and to establish future operational strategies, we evaluated the course and the students’ learning experience.
Methods
The subjects of this study were 97 students of a pre-medical course “Self-development and portfolio I” in 2019. Their learning experience was evaluated through the professor’s assessment of portfolios they had submitted, and the program was evaluated based on the responses of 68 students who completed a survey. The survey questionnaire included 32 items. Descriptive statistics were reported for quantitative data, including the mean and standard deviation. Opinions collected from the open-ended question were grouped into categories.
Results
The evaluation of students’ portfolios showed that only 6.2% of the students’ portfolios were well-organized, with specific goals, strategies, processes, and self-reflections, while most lacked the basic components of a portfolio (46.4%) or contained insufficient content (47.4%). Students’ responses to the survey showed that regular portfolio personality assessments (72.1%), team (64.7%), and individual (60.3%) activities were felt to be more appropriate as educational methods for this course, rather than lectures. Turning to the portfolio creation experience, the forms and components of the portfolios (68.2%) and the materials provided (62.2%) were felt to be appropriate. However, students felt that individual autonomy needed to be reflected more (66.7%) and that this course interfered with other studies (42.5%).
Conclusion
The findings of this study suggest that standardized samples, guidelines, and sufficient time for autonomous portfolio creation should be provided. In addition, education on portfolio utilization should be conducted in small groups in the future.

Citations

Citations to this article as recorded by

Medical Student Portfolios: A Systematic Scoping Review
Rei Tan, Jacquelin Jia Qi Ting, Daniel Zhihao Hong, Annabelle Jia Sing Lim, Yun Ting Ong, Anushka Pisupati, Eleanor Jia Xin Chong, Min Chiam, Alexia Sze Inn Lee, Laura Hui Shuen Tan, Annelissa Mien Chew Chin, Limin Wijaya, Warren Fong, Lalit Kumar Radha K
Journal of Medical Education and Curricular Development.2022; 9: 238212052210760. CrossRef
Development and validation of a portfolio assessment system for medical schools in Korea
Dong Mi Yoo, A Ra Cho, Sun Kim
Journal of Educational Evaluation for Health Professions.2020; 17: 39. CrossRef

Satisfaction with and suitability of the problem-based learning program at the Catholic University of Korea College of Medicine: Dong Mi Yoo, A Ra Cho, Sun Kim; J Educ Eval Health Prof. 2019;16:20. Published online July 19, 2019; DOI: https://doi.org/10.3352/jeehp.2019.16.20

13,067 View
217 Download
5 Web of Science
4 Crossref

Abstract PDF Supplementary Material

Purpose
This study was conducted to identify suggestions for improving the effectiveness and promoting the success of the current problem-based learning (PBL) program at the Catholic University of Korea College of Medicine through a professor and student awareness survey.
Methods
A survey was carried out by sending out mobile Naver Form survey pages via text messages 3 times in December 2018, to 44 medical students and 74 professors. In addition, relevant official documents from the school administration were reviewed. The collected data were analyzed to identify the achievement of educational goals, overall satisfaction with, and operational suitability of the PBL program.
Results
The overall satisfaction scores for the PBL program were neutral (students, 3.27±0.95 vs. professors, 3.58±1.07; P=0.118). Regarding the achievement of educational goals, the integration of basic and clinical medicine and encouragement of learning motivation were ranked lowest. Many respondents expressed negative opinions about the modules (students, 25.0%; professors, 39.2%) and tutors (students, 54.5%; professors, 24.3%). The students and professors agreed that the offering timing of the program in medical school and the length of each phase were suitable, while opinions expressed in greater detail pointed to issues such as the classes being held too close to exams and their alignment with regular course units.
Conclusion
Issues with modules and tutors were the most pressing. Detailed and appropriate modules should be developed on the basis of advice from professors with experience in PBL tutoring. Inconsistencies in tutoring should be reduced by standardization and retraining.

Citations

Citations to this article as recorded by

Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review
Joan Carles Trullàs, Carles Blay, Elisabet Sarri, Ramon Pujol
BMC Medical Education.2022;[Epub] CrossRef
Student and Tutor Satisfaction with Problem-Based Learning in Azerbaijan
Ulkar Sattarova, Wim Groot, Jelena Arsenijevic
Education Sciences.2021; 11(6): 288. CrossRef
A scoping review of clinical reasoning research with Asian healthcare professionals
Ching-Yi Lee, Chang-Chyi Jenq, Madawa Chandratilake, Julie Chen, Mi-Mi Chen, Hiroshi Nishigori, Gohar Wajid, Pai-Hsuang Yang, Muhamad Saiful Bahri Yusoff, Lynn Monrouxe
Advances in Health Sciences Education.2021; 26(5): 1555. CrossRef
Newly appointed medical faculty members’ self-evaluation of their educational roles at the Catholic University of Korea College of Medicine in 2020 and 2021: a cross-sectional survey-based study
Sun Kim, A Ra Cho, Chul Woon Chung
Journal of Educational Evaluation for Health Professions.2021; 18: 28. CrossRef

First
Prev
Page of 1
Next
Last

Search